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Abstract 



Since the first recordings made of evoked action potentials it has be- 
come apparent that the responses of individual neurons to ongoing 
physiologically relevant input, are highly variable. This variability is 
manifested in non-stationary behavior of practically every observable 
neuronal response feature. Here we introduce the Neuronal Response 
Clamp, a closed-loop technique enabling full control over two important 
single neuron activity variables: response probability and stimulus- 
spike latency. The technique is applicable over extended durations (up 
to several hours), and is effective even on the background of ongoing 
neuronal network activity. The Response Clamp technique is a power- 
ful tool, extending the voltage-clamp and dynamic-clamp approaches 
to the neuron's functional level, namely - its spiking behavior. 
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Introduction 

The responses of single neurons and neuronal populations to ongoing 
stimuli within a physiological range of frequencies are highly variable; 
this variability is manifested in both the ability to evoke an action 
potential and the latency between stimulus and response. Response 
variability was already obvious a century ago, when Adrian and Zot- 
terman described a "lack of regularity" in the "all-or-none" impulse 
response in their classical paper (Adrian & Zotterman, 1926), the first 
documentation of recorded action potentials. Nowadays, response vari- 
ability is generally accepted to be an important phenomenon (Stein, 
1965; Mainen & Sejnowski, 1995; Arieli, Sterkin, Grinvald, & Aertsen, 
1996; Reich, Victor, Knight, Ozaki, & Kaplan, 1997; Arsiero, Luscher, 
Lundstrom, & Giugliano, 2007; Soteropoulos & Baker, 2009) that re- 
flects the immensity of involved cellular level machineries, covering any 
observable cell-physiology timescale (Marom, 2010). Analyses of the 
sources of response variability, as well as its impact on neuronal func- 
tionality, is practically intractable due to the non-linearity involved in 
the reciprocal relations between response variability and its underlying 
sources. 

It would be highly desirable to develop a method for controlling 
the reliability of neuronal responses to input. By studying the sig- 
nals required to achieve this control one may hopefully shed light on 
the input-output relationships of the neuron as well as lead to a bet- 
ter understaning of the underlying sources of response variability. In 
this context, analogy to the voltage-clamp method (Hodgkin, Huxley, 
& Katz, 1952) immediately comes to mind. There, Hodgkin, Hux- 
ley and Katz studied the dependency of conductances on voltage by 
"clamping" the membrane potential and analyzing the required control 
signals (currents). By doing so, they broke the circular relationships 
between membrane voltage and voltage-dependent conductances; in- 
deed, one cannot imagine neuronal physiology without the insights 
that the voltage-clamp method provided throughout the years. 
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In this study we present and demonstrate the concept of Neuronal 
Response Clamp. The idea is to "clamp" a defined feature of the neu- 
ronal spiking response. This is achieved by implementing a control cir- 
cuit that measures pre-defined neuronal response characteristics, com- 
pares them to desired values, and corrects errors by changing stimu- 
lation features. Specifically, we devised a closed-loop real-time system 
that implements what is known as a Proportional-Integral-Derivative 
(PID) controller in system engineering (Levine et al., 1996), to com- 
pute the "error" signal between desired and actual neuronal responses, 
and correct the error by manipulating the stimulation frequency. Here 
we show that this system fully restrains the variability of neuronal spik- 
ing probability, and provides complete control over the precise latency 
between stimulus and response, both in synaptically isolated neurons, 
and within the context of active networks. 
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Materials and Methods 
Cell preparation 

Cortical neurons were obtained from newborn rats (Sprague-Dawley) 
within 24 hours after birth using mechanical and enzymatic procedures 
described in earlier studies (Marom & Shahaf, 2002). The neurons 
were plated directly onto substrate-integrated multi electrode arrays 
and allowed to develop functionally and structurally mature networks 
over a time period of 2-3 weeks. The number of neurons in a typi- 
cal network is on the order of 10,000. The preparations were bathed 
in MEM supplemented with heat-inactivated horse serum (5%), glu- 
tamine (0.5 mM), glucose (20 mM), and gentamycin (10 g/ml), and 
maintained in an atmosphere of 37°C, 5% CO2 and 95% air in an incu- 
bator as well as during the recording phases. An array of Ti/Au/TiN 
extracellular electrodes, 30^m in diameter, and spaced either 500 
or 200 fim from each other (MultiChannelSystems, Reutlingen, Ger- 
many) were used. The insulation layer (silicon nitride) was pre-treated 
with polyethyleneimine (Sigma, 0.01% in 0.1M Borate buffer solu- 
tion). To completely block synaptic transmission in the network, 20 
fiM APV (amino-5-phosphonovaleric acid), 10 fiM CNQX (6-cyano-7- 
nitroquinoxaline-2,3-dione), and 5 fiM Bicuculline were added to the 
bathing solution. 

Measurements and Stimulation 

A commercial amplifier (MEA-1060-inv-BC, MCS, Reutlingen, Ger- 
many) with frequency limits of 150-3, 000Hz and a gain of xl024 was 
used. Rectangular 200 fis biphasic 20-50 fiA current or 600-800 mV 
stimulation through extracellular electrodes was performed using a 
dedicated stimulus generator (MCS, Reutlingen, Germany). Data was 
digitized using data acquisition board (PD2-MF-64-3M/12H, UEI, Walpole, 
MA, USA). Each channel was sampled at a frequency of 16 Ksample/s 
(for spike probability experiments) or 96 Ksamples/s (for spike latency 
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experiments). Action potentials were detected online by threshold 
crossing. All spike times and shapes, as well as 15 ms voltage traces 
from all electrodes after each stimulus, were recorded for analyses. 
Data processing and closed-loop stimulation was performed using a 
Simulink (The Mathworks, Natick, MA, USA) based xPC target ap- 
plication. 

Computing spike probability on-line 

Let s n be an indicator function, so that s n = 1 if the neuron generated 
a spike on the n th stimulus and s n = otherwise. We define 7r(t) as 
the probability of the neuron to emit a spike if it is stimulated at time 
t. We can estimate this probability using all past responses {si}™ =l at 
times {ti}" = i, by integrating them with an exponential kernel, 

n 

~ tn — tp r — tj — tj — i tn—tj 

P n = e - +2_^s t (l-e * )e * , 

i=l 

where r is the kernel's time-constant (10-30 sec in the experiments 
presented). To compute this on-line, we used the recursive formula: 

P n = s n (l - e T ) + Pn-ie T . 

PID Controller 

A Proportional-Integral-Derivative (PID) controller was realized on the 
xPC target system. The input to the controller is the error signal, 

where R* n and R n are the desired and actual response to the n th stim- 
ulus, respectively. The output of the controller is generally composed 
of three components, 

n 

Vn = gpe n + gi^2&i + 9D(e n - en-!) 

i=0 
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where gp, gj and gp are the proportional, integral and derivative gains, 
respectively (in the experiments presented in this work, gp was 25- 
30Hz, gi was 0. 125-0. 56Hz and gp, was 0-125Hz). Finally, the instan- 
taneous stimulation frequency (i.e. the reciprocal of the ISI) consisted 
of the controller's output and some 'baseline' frequency: 

fn = Vn H~ fbaselinet 

where fbaseiine was 2Hz in latency experiments and 6.67Hz in proba- 
bility experiments. In our system, the maximal stimulation rate was 
40 Hz. In the case of failed spikes when latency was controlled, the 
controller maintained the same stimulation frequency that produced a 
spike at a previous stimulus. 
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Results 



The experiments described in this work were conducted in networks of 
rat cortical neurons, plated in-vitro on a substrate that caters to ex- 
tracellular recording and stimulation of electrical activity, at the single 
cell level. Evoked spiking activity of a given individual neuron in such 
a network, reflects both the direct effect of external stimulation, as 
well as the effects of synaptic activations by other neurons (Marom & 
Shahaf, 2002). We first examine the capacity of the Neuronal Response 
Clamp technique to control the variability of neuronal responses of neu- 
rons that are isolated from the network by pharmacologically blocking 
all major types of synaptic inputs (APV [amino-5-phosphonovaleric 
acid; 20 //M], CNQX [6-cyano-7-nitroquinoxaline-2,3-dione; 10 //M], 
and Bicuculline [5 fiM]). 

Under complete blockade of synaptic transmission, all spontaneous 
activity dies out and the network becomes quiescent (Marom & Shahaf, 
2002). At this state, applying a single, short (sub-millisecond) pulse 
between two electrodes, generates a single action potential in a subset 
of neurons. The dynamics of the single neuron response may thus be in- 
terrogated using a long sequence of stimuli. We refer to this stimulation 
scenario as an open loop protocol, since the (predefined) stimulation 
sequence is not affected by the evoked neuronal responses. In the open 
loop protocol, the nature of the evoked responses leads to a distinction 
between two qualitatively different stimulation regimes: When stim- 
ulation rate is low (below 5-7 Hz), response probability is practically 
one, i.e. the neuron responds almost to each and every stimulus, and 
the time-delay (latency) between the stimulus and the evoked spike 
is quite stable (Figure 1 middle panel). At higher stimulation rates, 
both response probability and response latency gradually become un- 
stable, exhibiting considerable, seemingly erratic fluctuations (Figure 
1 bottom). Figure 2 depicts the dynamics of the two features (referred 
to collectively as the neural response) at three stimulation rates (1, 5, 
and 20 Hz) over extended timescales. Note the slow drift of response 
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latency in the 5 Hz stimulation experiment, probably reflecting slow 
modulations of membrane excitability. 

Thus, two features of neural activity, response latency and response 
probability, emerge as natural candidates for stabilization using the Re- 
sponse Clamp technique. These two features are markers of the neu- 
ronal excitability status, reflecting the balance between exciting and 
restoring membrane conductances. In order to clamp these two fea- 
tures, continuous, online estimation of their values is required. Unlike 
response latency, which can be measured individually for each of the 
evoked action-potentials, response probability must be estimated based 
on recent spiking history (i.e. using several responses). We calculate 
this latter measure by convolving the spiking history with an expo- 
nential kernel, which means that recent responses are given a greater 
weight (explained in Materials and Methods). 

The two response features mentioned above possess a useful qual- 
ity, from the point of view of control: they exhibit a simple, monotonic 
relationship with the instantaneous stimulation rate. Increasing the 
rate (i.e. by shortening the inter-stimulus-interval) leads to predictable 
outcomes, namely a decrease in spike probability and an increase in 
spike latency. Therefore, negative feedback may be used in order to 
produce a desired response, either constant or time-varying. This is 
achieved in the following manner (Figure 3): A response feature to be 
clamped is chosen (either response probability or response latency). 
Following each stimulus, a clamp error is computed by comparing the 
evoked response with its desired value. This error signal is then fed 
into a PID controller which accordingly alters the stimulation rate in 
order to decrease the error towards zero. The PID controller consists of 
three components: the proportional component (P) supplies the neces- 
sary negative feedback; the integrated component (I) counteracts slow 
changes in the system's responsiveness; and the derivative component 
(D) contributes dissipation needed to damp oscillations. For details on 
controller construction and implementation see Methods. 

We first compared the neuronal response in open-loop, where stim- 
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illation rate is maintained constant, to the neuronal response under 
closed-loop conditions in synaptically isolated neurons for both re- 
sponse features, over a wide range of stimulation rates and response 
levels. In contrast to the open loop response, the response under closed- 
loop conditions quickly converges to the desired value (Figure 4); the 
clamp may be maintained for up to several hours (see below). Thus, 
Response Clamp counteracts the slow trends observed in the spike re- 
sponse latency, and restrains the huge fluctuations of the spike response 
probability. The response clamp technique is reliable and robust: Fig- 
ure 5 summarizes the results of 131 experimental blocks, showing that 
the standard deviation in response probability is markedly decreased 
under closed loop, compared to open loop stimulation regimes. The 
robustness of the technique is reflected in the fact that no fine-tuning 
of the PID gain parameters was required in order to achieve successful 
clamp. 

We were interested to determine whether it is the specific pattern 
of stimulation, evoked by the controller is sufficient, in and by itself to 
restrain response variability. We therefore played-back a stimulation 
pattern produced by the controller under Response Clamp conditions, 
to stimulate the same neuron again in an open-loop manner. Although 
the "replayed" input sequences were identical, stability quickly deteri- 
orated and the response probability diverged from the desired value 
(Figure 6). Thus, feedback is essential in order to achieve response 
stabilization: the exact temporal pattern of the stimulation series does 
not, in and by itself, cause stable neuronal response; rather, the instan- 
taneous state of the neuron must be continuously monitored and taken 
into account while computing the control signal. Note that the result- 
ing response rate (i.e. the product of stimulation rate and response 
probability), while not constant in either the open loop or under Re- 
sponse Clamp, is significantly more stable in the latter condition. Also, 
note the duration of the experiment presented in Figure 6, extending 
over 3 hours. The control signal in this long experiment, as well as 
in similarly long experiments (results not shown), exhibits complex 
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dynamics that expose the myriad underlying adaptive processes. 

In all the above mentioned experiments the response was clamped to 
a constant value. However, the neuronal response can also be clamped 
to a desired time-varying pattern. To demonstrate this capacity we 
performed an experiment where the desired response latency is grad- 
ually ramped up and down to three different values (Figure 7). We 
observed that in the time- varying clamp, the rate at which the de- 
sired response may be changed is limited by the maximal and minimal 
stimulation rates; if the controller surpasses these values, its output 
saturates and the stimulation loop is effectively broken. 

In all the experiments described so far, neurons were pharmacolog- 
ically isolated from the network input. It was not at all obvious that 
the ability of the response clamp to restrain response variability would 
be conserved once ongoing input from the network is allowed. We thus 
repeated the experiments described above without blocking synaptic 
transmission, i.e. when the neuron is embedded in an active network. 
We found that the Response Clamp technique was equally effective 
under these conditions (Figure 8). Moreover, analyzing spikes simulta- 
neously recorded from many different neurons in the network (beyond 
the controlled neuron), revealed that the responses of these other neu- 
rons fall into two broad categories: Some neurons were influenced by 
the dynamic control over the target (controlled) neuron, whereas oth- 
ers seem to be completely unaffected. These results suggest that the 
Response Clamp technique may be used as a tool to study single neu- 
ron dynamics even when isolation of the neuron from its context is 
impossible or undesirable. 
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Discussion 



In this study we show that evoked neuronal spiking patterns may be 
controlled using a simple feedback system. The Response Clamp design 
was applied to control either the time delay between stimulus and an 
evoked spike, or the probability of evoked spikes. Control of these 
response variables was shown to be applicable both when the target 
neuron is synaptically isolated from the rest of the network, and on 
the background of ongoing synaptic input. 

Historically, the concept of feedback control proved effective in the 
analyses of excitability. Its use, however, was largely focused on the 
study of specific membrane conductances under voltage-clamp and 
patch-clamp conditions (Hodgkin et al., 1952; Neher, Sakmann, & 
Steinbach, 1978). The approach was further advanced by the dynamic- 
clamp experimental design to unfold the impacts of specific conduc- 
tances on the dynamics of the overall excitability (Sharp, O'Neil, Ab- 
bott, & Marder, 1993). In that context, the methodology presented 
here is a natural step up in the ladder of organization levels. It enables 
control of neuronal response patterns at the macroscopic level, without 
monitoring underlying microscopic variables. 

One should bear in mind that in the original voltage-clamp stud- 
ies of action potential generation the variable under control (namely, 
membrane potential) determines the reaction rates of all the relevant 
processes, so that the closed loop behavior becomes linear and time in- 
variant. In contrast, in the dynamic clamp method only a few compo- 
nents of the system are being controlled, with the hope of illuminating 
the role of these components in the overall behavior. In this context 
the method suggested here resembles the dynamic clamp in the sense 
that only the processes that depend on the responsiveness of the sys- 
tem are being clamped. Hopefully, this may aid in the identification of 
these processes and the evaluation of their contribution to the response 
dynamics. 

Two technical difficulties in the design of the Response Clamp must 
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be noted. First, unlike the membrane potential which may be moni- 
tored continuously, the neuron must be externally perturbed in order 
to estimate its state (i.e. responsiveness to stimulation). Therefore, 
the controller is always "one step behind" the system being controlled. 
Since these perturbations themselves affect the neuron's responsive- 
ness, a classic "observer effect" arises. This problem becomes more 
pronounced in the case of neural response probability, where the state 
is estimated using past spiking history. Future improvements of the 
state estimation process might incorporate compensation for the effects 
of external stimulation. 

A second limitation in implementing the Response Clamp technique 
relates to the response features to be controlled. The choice of response 
latency and response probability stems from the need for a predictable 
reaction to changes in stimulation rate. This does not necessarily re- 
quire a monotonic relationship; a successful clamp may be realized 
as long as the short term outcomes of modifying the stimulation are 
predictable. 

The Response Clamp technique offers the potential of facilitating 
full characterization of the input-output relationships of the neuron. 
This challenge is practically intractable in open loop due to the nonlin- 
earity of the system and the cumulative effect of underlying processes 
spanning a wide range of timescales. By manipulating well-defined 
features of the neuronal responsiveness, one may hope to control state- 
dependent dynamics, thus enabling the identification of the role of such 
processes in the overall behavior of the system. 
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Figures 



a 




Figure 1: Evoked responses of an isolated neuron in-vitro to periodic stimulation in 
open loop. The top panel (a) shows a single extracellular voltage trace recorded for 
20 ms, beginning at the onset of stimulation. The stimulus artifact lasts for 1-2 ms 
(shaded area). Response latency is the time elapsed from the onset of stimulation 
to the detected peak of the action potential; in our system, response latency is in 
the range of 3-10 ms. (b) Traces (every 10th, shown top to bottom) in response 
to a low (1 Hz) stimulation rate. Spiking under this condition is highly regular 
and the latency is constant, (c) Traces (every 10th, shown top to bottom) of the 
same neuron when stimulation rate is high (20 Hz). Both response probability and 
latency rapidly become irregular under this condition. 
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Figure 2: Response latency (a) and response probability (b) for three open loop 
stimulation rates. At extremely low stimulation rate (1 Hz, depicted yellow), 
response is highly reliable (i.e. response probability is one) and response latency is 
practically constant. At higher stimulation rate (5 Hz, depicted purple), response 
probability is also one, but slow trends in the response latency appear, probably 
reflecting slow processes of inactivation. At high stimulation rate (20 Hz, depicted 
blue) both response probability and response latency are highly unstable. The 
response probability was computed using 2 s bins. 



18 



desired 
response 




measured response 



Figure 3: General scheme of a PID controller, designed for clamping neuronal re- 
sponses (stimulus-spike time delay, or response probability). The error signal is 
calculated (feedback), and subjected to three different transformations that addi- 
tively dictate the nature of stimulation needed for clamping the response. This is 
standard control algorithm was implemented within a Simulink environment. 
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Figure 4: Demonstration of the neuronal Response Clamp. In each of the panels, 
two experiments are shown (depicted by two different colors). Top row shows 
examples of controlling response probability (a) and stimulus-spike time delay 
(b). Two clamped values are demonstrated in each of these panels. Note the 
stability of the clamped response. In contrast, when the average stimulation rates 
used for the clamping procedure of the two top panels are applied under open loop 
conditions (c and d), the response develops marked fluctuations. This is especially 
apparent when response probability (c) is considered. 
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Figure 5: The Response Clamp consistently decreases the variability of response 
probability. Neuronal response probability was clamped to different values ranging 
from 1 to 0.25, for 10 to 15 minutes. The response's standard deviation during 
this period is compared with that of the same neuron, when the mean rate used 
during the clamp period is re-applied in an open loop design (see the examples 
depicted in Figure 4). Data from 131 such experimental sessions conducted on 
3 different neurons (each in a different culture, depicted by different colors) are 
presented. The data are normalized to the maximal standard deviation acquired 
for each neuron. Histograms of the data are aligned to the relevant axes. 
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Figure 6: Demonstration of the importance of feedback in the stabilization of 
neuronal response probability. Stimulation rate (a), response probability (b) and 
response rate (c) at two stimulation scenarios are depicted. First, the neuron's 
response probability was clamped to a constant value (0.67) for three hours (blue). 
Then, the stimulation pattern generated by the controller was replayed in open 
loop (purple). Stability of both response probability and response rate is obtained 
only in the presence of feedback. 




time, s 

Figure 7: Demonstration of time varying Response Clamp. Response latency 
was clamped, while the desired value (depicted blue) was gradually increased and 
decreased alternatingly. Latency is normalized so that the baseline level (i.e. the 
latency at an extremely low stimulation rate, in the example presented here it is 
6 ms) is and maximal latency detected (10 ms in this example) is set to 1. Note 
that at extremly high latency values the behavior becomes irregular and the clamp 
is effectively lost. 
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Figure 8: Time varying Response Clamp of a neuron with background synaptic 
input, (a) A neuron that responds (blue) directly to external stimulation was 
controlled to follow a sine-wave response probability pattern (12 minutes period, 
range between 0.75 and 0.25, depicted light green). The figure shows the response 
probability of another, directly stimulated yet uncontrolled neuron (purple). The 
response of such neurons, while not follwing the desired response closely like the 
controlled neuron does, is modulated by the clamp. The figure also presents the 
response probability of yet another neuron, which is not affected directly by the 
stimulation, but is activated by the synaptic inputs it recieves from the network 
(yellow). The activity of such neurons seems to be unaffected by the clamp. This 
is also apparent by looking at the spike rate histogram of 20 other neurons in 
the network (b, 10 s bins), demonstrating the presence of uninterrupted on-going 
background activity in the network. 
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